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THE MAP AND RELATED DECODING 

ALGORITHMS 


In a coded communication system with equiprobable signaling, MLD minimizes 
the word error probability and delivers the most likely codeword associated with 
the corresponding received sequence. This decoding has two drawbacks. First, 
minimization of the word error probability is not equivalent to minimization of 
the bit error probability. Therefore, MLD becomes suboptimum with respect 
to the bit error probability. Second, MLD delivers a hard-decision estimate of 
the received sequence, so that information is lost between the input and output 
of the ML decoder. This information is important in coded schemes where the 
decoded sequence is further processed, such jus concatenated coding schemes, 
multi-stage and iterative decoding schemes. 

In this chapter, we first present a decoding algorithm which both minimizes 
bit error probability, and provides the corresponding soft information at the 
output of the decoder. This algorithm is referred to as the MAP (maximum a- 
posteriori probability) decoding algorithm [l] . Unfortunately, the trellis-based 
implementation of the MAP algorithm is much more complex than that of the 
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trellis-based MLD algorithms presented in the previous chapters. Consequently, 
suboptimum versions of the MAP algorithm with reduced decoding complex- 
ity must be considered for many practical applications. In Section 13.2, we 
present a near- optimum modification of the MAP algorithm, referred to as the 
Max-Log-MAP (or SOVA) decoding algorithm [34, 39, 40]. This near-optimum 
algorithm performs within only few tenths of a dB of the optimum MAP de- 
coding algorithm while reduces decoding complexity drastically. Finally, the 
minimization of the bit error probability in trellis-based MLD is discussed in 
the last section. 


13.1 THE MAP DECODING ALGORITHM 


Consider a binary ( N,K ) linear block code C. Let u = (ui,u 2l . . . ,ujv) be a 
codeword in C. Define P{A\B) as the conditional probability of the event A 
given the occurrence of the event B. The MAP decoding algorithm evaluates 
the most likely bit value m at a given bit position i based on the received 
sequence r = (r^, r 2 , . . . ,r#). It first computes the log-likelihood ratio 


L x 


A 


log 


P(u, = ljr) 
P(u, = 0|r) 


(13.1) 


for 1 < i < N, and then compares this value to a zero-threshold to decode u t 


as 


Ui = 


1 for L{ > 0, 
0 for L x < 0. 


(13.2) 


The value Li represents the soft information associated with the decision on u,. 
It can be used for further processing of the sequence ti delivered by the MAP 


decoder. 

In the 7V-section trellis diagram for the code, let Bi(C) denote the set of 
all branches (<Ti_i,< 7 ,) that connect the states in the state space Ei-i(C) at 
time-(t — 1) and the states in the state space E,(C) at time-i for 1 < t < N. Let 
B“(C) and B}(C) denote the two disjoint subsets of B<(C) that correspond to 
the output code bits u, = 0 and u, = 1, respectively, given by (3.3). Clearly 


B,(C) = Bi(C) U B-(C) 


(13.3) 


for 1 < i < N. For (o',cr) € Bi(C), we define the joint probability 
A,((7',£t) = P(ffi_ i = a'\Oi = u;r) 


(13.4) 
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for 1 < » < N. Then 


J5 

c 

II 

© 

1 

II 

M 

(13.5) 

(<r»€B«(C) 


P(u ; = l;r) = 53 

(13.6) 


(<7»€B}(C) 


The MAP decoding algorithm computes the probabilities A,(cr', ct) which are 
then used to evaluate P(u, = 0|r) and P(u{ = l|r) in (13.1) from (13.5) and 

(13.6). 

For 1 < t < AT, 1 < / < m < N, and rj 71 = ,r m ), we define the 

probabilities 


«.(*) A 

P{<Ji = ffirj), 

(13.7) 

AM = 


(13.8) 

7<K*) A 

P{(Ti = (Tirilo-j-, = <r') 


= 

P(r < |(«r i _i,<T < ) = [a\ a )) P{pi = trlcri-, = < 7 '). 

(13.9) 


Then, for a memoryless channel, 


^ ) 0i{cr) (13.10) 

for 1 < i < N, which shows that the values > t (cr',cr) can be evaluated by 
computing all values a; (a), Pi{&) and 7 i(a\cr). Ilased on the total probability 
theorem, we cam express ai(cr), for 1 < i < N, as follows: 

Q >( a ) = 53 P(^i-i = cr'^i = o-;ri _1 ;r,) 

«r'CSi_i(C) 

= 53 Q,-i(«r') Ti^'.ff)- (13.11) 

(7 f €S,_l{C) 


Similarly, for 1 < i < N, 

A( ff ) = 53 ^ > ( r *+x; r i^2;°<+i = a 'Wi - <0 

0-'€E. + i(C) 

= 53 ft+iMn+it' 7 /)' 

ir'€Si + i(C) 


(13.12) 
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From ( 13 . 11 ), we see that the probabilities 0^(0) with 1 < * < N can be 
computed recursively from the initial state 0<j to the final state 07 of the N- 
section trellis for code C, once 7^(0', <r)’s are computed. This is called the 
forward recursion. From ( 13 . 12 ), we see that the probabilities ^(0) with 
1 < * < N can be computed recursively in backward direction from the final 
state 0/ to the initial state 00 of the JV-section trellis of C. This is called the 
backward recursion. 

For the AWGN channel with BPSK transmission, we have 

P(r, = a'\Oi — a) = {*N 0 )~ 1/2 exp(-(rj - c,) 2 /N 0 ) 6i(<r\a), ( 13 . 13 ) 


where 


<5 i{<r',<r) 


1 if (<r',<r) e B t (C), 
0 if 


( 13 . 14 ) 


For 5i(<r',<r) — 1 , Ci = 2 u; — 1 is the transmitted signal corresponding to the 
label u, of the branch (ff'.ff). Based on ( 13 . 13 ), 7 x{cr\°) is proportional to the 
value 


il' i ( 0 / > 0 ) = exp(~(r t - Ci) 2 /No) S t (cr\cr) P{<J{ = 0|0*-i — cr f ). (13.15) 

Note that in many applications such as MAP trellis-based decoding of linear 
codes, the a-priori probability of each information bit is the same, so that all 
states 0 G £t(C) are equiprobable. Consequently, P{<? x — cr|cr t _i = 0') be- 
comes a constant that can be discarded in the definition of Wx{<t\<t), However, 
this is not true in general. For example, in iterative or multi-stage decoding 
schemes P{a x = 0)0^1 = 0') has to be evaluated after the first iteration, or 
after the first decoding stage. Since in ( 13 . 1 ), we are interested only in the 
ratio between P(u x = l|r) and P(u{ = 0|r), Ai(0*,0) can be scaled by any 
value without modifying the decision on tij. Based on these definitions, 01,(0) 
can be computed recursively based on ( 13 . 11 ) using the trellis diagram from 
the initial state 0 O to the final state 0/ as follows: 

(1) Assume that cri_i(0') has been computed for all states 0' G Ei-i(C). 

(2) In the i-th section of the trellis diagram, associate the weight 1^(0', 0) 
with each branch (0^,0) G B X (C). 
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(3) For each state a £ E;(C), evaluate and store the weighted sum 

<*<(<0 = ]T) u>i(<r\<7) ari_i(<7'). (13.16) 

The initial conditions for this recursion are ao(<ro) = 1 and ao(^) = 0 for 
<y 7 *" cr 0 . 

Similarly, 0i(<r) can be computed recursively based on (13.12) using the 
trellis diagram from the final state a j to the initial state <jq as follows: 

(1) Assume that /W*') has been computed for all states a' € E i+ 1 (C). 

( 2 ) In the (t + l)-th section of the trellis diagram, associate the weight 
uji+i(< 7 , a 1 ) with each branch (a,cr') £ £;+i(C). 

(3) For each state cr £ Ei(C), evaluate and store the weighted sum 

Pi ( <T ) = X] Wi+\(<7y cr') 0i+i(cr f ). (13.17) 


The corresponding initial conditions are =■. 1 and 0n{<j) = 0 for a ^ a /. 

The MAP decoding algorithm requires one for vard recursion from <r 0 to 07 , 
and one backward recursion from a/ to (To to evaluate all values a^) and @i{cr) 
associated with all states a x £ £ t (C), for 1 < * < N. These two recursions 
are independent of each other. Therefore, the forward and backward recursions 
can be executed simultaneously in both directions along the trellis of the code 
C. This bidirectional decoding reduces the decoding delay. Once all values of 
a,(cr) and for 1 < i < N have been determined, the values L x in (13.1) 

can be computed from (13.5), (13.6), (13.9) and '13.10). 

13.2 THE SOVA DECODING ALGORITHM 

The MAP decoding algorithm presented in the previous section requires a large 
number of computations and a large storage to < ompute and store the proba- 
bilities a t (cr), A(<t) and 7 ,( 0 *', cr) for all the stat ;s <7 and state pairs (cr\a) in 
the trellis for the code to be decoded. For a loi g code with large trellis, the 
implementation of the MAP decoder is practical y impossible. Also, the MAP 
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decoding algorithm computes probability values, which require much more com- 
plicated real value operations than the read additions performed by trellis-based 
MLD algorithms, such as the Viterbi decoding and RMLD algorithms. 

In this section, we present an algorithm for which the optimum bit error 
performance associated with the MAP algorithm is traded with a significant 
reduction in decoding complexity. This algorithm is known as the Max-Log- 
MAP algorithm or soft-output Viterbi algorithm (SOVA), as it performs 
the same operations as the Viterbi algorithm, with additional real additions 
and storages. 

For BPSK transmission, (13.1) can be rewritten as 


U = log 


(e ■ 


(13.18) 


for 1 < * < N and Cj = 2u; - 1. Based on the approximation 


log(5» * 1 °8 ( >€{ ™ x 

3 = 1 


(13.19) 


we obtain from (13.18) 

Li « log( max P(c|r)) - log( max P(c|r)). 


(13.20) 


For each code bit u„ the Max-Log-MAP algorithm [40] approximates the cor- 
responding log-likelihood ratio Li based on (13.20). 

For the AWGN channel with BPSK transmission, we have 


P(c|r) = P(r|c)P(c)/P(r) 

= {■KNo)- NJ2 e-'Z^ ir i- c > )7/N °P{c)/P{r). ( 13 . 21 ) 

If c 1 = (cj, cj, ... , cjj— l > Ojj , • • •) and c° = (c°,c®, . . . ,c 0 2 j _ v c ° 2 . . .) represent 
the codewords corresponding to the first term and the second term of ( 13 . 20 ), 
respectively, it follows from ( 13 . 21 ) that for equiprobable signaling, the approx- 
imation of Li given in ( 13 . 20 ) is proportional to the value 

r * + Y, c ; r r 


(13.22) 
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We observe that one of the terms in (13.20) corresponds to the MLD solution, 
while the other term corresponds to the most likely codeword which differs from 
the MLD solution in u*. Consequently, in Max-Log-MAP or SOVA decoding, 
the hard-decision codeword corresponding to (13.20) is the MLD codeword 
and (13.22) is proportional to the difference of squared Euclidean distances 
(SED) || r — c 1 1| 2 - ||r - c°|| 2 . For any two codewords c and d , we define 
|||r — c|| 2 — ||r — c / || 2 | as the reliability difference between c and d . 

For simplicity, we consider the trellis diagram of a rate- 1/2 antipodal con- 
volutional code C. Hence, the two branches that merge into each state have 
different branch labels, as described in Figure 10.1. Also, we assume that 
the trellis diagram for the code C is terminated so that N encoded bits are 
transmitted. Generalization of the derived results to other trellis diagrams is 
straightforward, after proper modification of the notations. At each state ai-i 
of the state space £i-i(C) at time-(t — 1), the SOVA stores the cumulative 
correlation metric value M(<Tj_i) and the corresponding decoded sequence 

c(cr,-i) = (c l (<r i _ 1 ),C2(<T,_l),...,C2(i-i)- 1 (ff<.l),C2(i_i ) (<T i _i)) , (13.23) 

as for the Viterbi algorithm. In addition, it also stores the reliability measures 
L(a t -x) = (Zi^-i), * • ■ •, L 2( i_i ) -i(cr i _i), > (13.24) 

associated with the corresponding decision c(<Xi_i). 

At the decoding tim e-i, for each state er, in the state space Li(C), the SOVA 
first evaluates the two cumulative correlation metric candidates cr,) 

and corresponding to the two paths terminating in state with 

transitions from stat es 1 and <j\_ x , respectively As for the Viterbi algorithm, 
the SOVA selects the cumulative correlation metric 

M(a x ) = max {Af(a]_ 1 ,^)} 1 (13.25) 

ie{ 1 , 2 } 

and updates the corresponding pair (c 2 i-i(<Ti),C 2 ;(<Ti)) in the surviving path 
c(<7,) at state a x . Next, L(a x ) has to be updated To this end, we define 

Ai = max {M ai)} - min {Af(<7{,, a\)}. (13.26) 

Based on (13.22) and the fact that the code considered is antipodal, we set 

L2i-l(cTi) = L2i{<Ji) — Ai, 


(13.27) 
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state (Ti+i- 

since A t represents the reliability difference between the two most likely code- 
sequences terminating at state a t with different values for both c 2 ;-i and c 2l . 
The remaining values L^i) for j = 1,. . . t 2(i - 1) of the surviving L{a x ) at 
state <Ti have to be updated. 

In the following, we simplify the above notations and define 

= - 4 ,..., L 2a-i)) ( 13 - 28 ) 

for l = 1,2, as the two sets of reliability measures corresponding to the two 
candidate paths merging into state <j{ with transitions from states cr|_ 1 and 
respectively. We refer to these two paths as path-1 and path-2, and 
without loss of generality assume that path-1 is the surviving path. Similarly, 
for / = 1,2, 

■ * ■ ’4(i-i)-i’4(i-i)) (13.29) 

represent the two sets of decisions corresponding to path-1 and path-2, respec- 
tively. 

First, we consider the case c] ^ c for some j € {l,...,2(t — 1)}, and 
recall that path-1 and path-2 have a reliability difference equal to A*. Also, 
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L\ ■ represents the reliability difference between path-1 and a code-sequence 
represented by a path-m merging with path-1 between the decoding steps j and 
(i — 1), with # c), as shown in Figure 13.1. On the other hand, Lj represents 

the reliability difference between path-2 and a code-sequence represented by a 
path-n merging with path-2 between the decoding steps j and (i — 1), with 
c" = cj. Hence, L 2 does not need to be considered to update Lj(a x ) in L(a x ). 
Since no additional reliability information is available at state <7\, we update 

Lj(ai) = min{Ai,L]}. (13.30) 


Next, we consider the case cj = Cy, for some j € {l,. . . , 2(t — 1)}, so that 
path-2 is no longer considered to update Lj(<7i) in L(<7i). However, path-n 
previously defined now satisfies c” ^ cj . Since the reliability difference between 
path-1 and path-n is A* + L 2 (i.e. the reliability difference between path-1 and 
path-2 plus the reliability difference between path-2 and path-n), we obtain 

L ; (cr t ) = min{A, + L 2 , L*}. (13.31) 


The first version of SOVA that is equivalent to the above development was 
introduced by Bat tail in 1987 [3]. This algorithm was later reformulated in con- 
junction with the MAP algorithm in [9, 61] and formally shown to be equivalent 
to the Max-Log-MAP decoding algorithm in [34]. Consequently, the Max-Log- 
MAP or SOVA decoding algorithm can be summarized as follows. 

For each state cr* of the state space Ei(C): 

Step 1: Perform the Viterbi decoding algorithm to determine the survivor 
metric M(cr x ) and the corresponding codc-sequence c(<Tj). 

Step 2: For j € {l,...,2(t — 1)}, set Lj(<j x ) in L(&i) either to the value 
min{Ai,Lj} if c ] • ^ c 2 , or to the value min{Ai +L 2 ,Lj} if c* = c 2 . 

Step 3: Set Z^i-i^i) and L, 2 i{cri) in If(^i) to the value A*. 

In [39], a simplified version of SOVA is presented. It is proposed to update 
Lj{cr x ), for j = 1,2, ...,2(i — 1), only when cj ^ c 2 . Hence (13.30) remains 
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unchange while (13.31) simply becomes: 

Lj{oi) = L). (13.32) 

Consequently, the values Lj are no longer needed in the updating rule, so that 
this simplified version of SOVA is easier to implement. At the BER 10 -4 , its 
performance degradation with respect to the MAP decoding algorithm is about 
0.6 - 0.7 dB coding gain loss, against 0.3 - 0.4 dB loss for the Max-Log-MAP 
decoding algorithm. 

13.3 BIT ERROR PROBABILITY OF MLD 

In many practical applications, soft output information is not needed and only 
the binary decoded codeword is delivered by the decoder. However, it is still 
desirable to minimize the bit error probability rather than the word error prob- 
ability. In such cases, the SOVA has no advantage over MLD since both algo- 
rithms deliver the same binary decoded sequence. Although the MAP decoding 
algorithm minimizes the decoding bit error probability, no significant improve- 
ment is observed over the bit error probability associated with MLD if properly 
implemented. Consequently, MLD remains to be the practical solution due to 
its much lower computational cost and implementation flexibility. However, 
when a word is in error, different mappings between the information sequences 
and the code sequences may result in a different number of bits in error, and 
hence a different average bit error probability. 

As described in Chapter 3, the trellis diagram for am (N, K) linear block 
code is constructed from its TOGM. A trellis-based ML decoder simply finds 
the most likely path and its corresponding codeword among the 2 K possible 
paths that represent all the codewords generated by the TOGM. Therefore, a 
trellis-based decoder can be viewed as a device which searches for the most 
likely codeword out of the set of the 2 K codewords generated by the TOGM, 
independent of the mapping between information sequences and codewords. It 
follows that the mapping between information sequences and the 2 K codewords 
generated by the TOGM, or equivalently the encoder, can be modified without 
modifying the trellis-based determination of the most likely codeword. The 
corresponding information sequence is then retrieved from the knowledge of 
the mapping used by the encoder. Consequently, a trellis-based ML decoder 
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can be viewed as the cascade of two elements: (1) a trellis search device which 
delivers the most likely codeword of the code generated by the TOGM; and (2) 
an inverse mapper which retrieves the information sequence from the delivered 
codeword. Although all mappings produce the same word error probability, 
different mappings may produce different bit error probabilities. 

Different mappings can be obtained from the TOGM by applying elementary 
row additions and row permutations to this matrix. Let Gt denote the TOGM 
of the code considered, and let G m denote the new matrix. If G m is used for 
encoding, then the inverse mapper is represented by the right inverse of G m . 
Since this mapping is bijective (or equivalently, G m has full-rank K) and thus 
invertible, the right inverse of G m is guaranteed to exist. In [33], it is shown 
that for many good codes, the best strategy is to have the K columns of the 
K x K identity matrix 1% in G m (in reduced echelon form). Based on the 
particular structure of the TOGM Gt, this is readily realized in K steps of 
Gaussian elimination as follows: For 1 < i < K, assume that G rn (i — 1) is the 
matrix obtained at step-(z — 1), with G m (0) = G t and G m (A') = G rn . Let 
c l = (cj, c\ y . . . , c' k ) t denote the column of G m (i — 1) that contains the leading 
T of the t-th row of G m (i — 1). Then c\ = I and cj +1 = c* +2 = • • ■ — c l K = 0. 
For 1 < j < i — 1, add row-i to row-; in G m (i ~ 1) if c‘ = 1. This results in 
matrix G m (ai). For : = AT, G m (K) = G m contains the K columns of / % with 
the same order of appearance. This matrix is said to be in reduced echelon 
form (REF), and is referred to as the REF matrix. 

Now we perform the encoding based on G m in REF instead of the TOGM G f . 
Since both matrices generate the same 2 K codewords, any trellis-based decoder 
using the trellis diagram constructed from the TOGM G* can still be used to 
deliver the most likely codeword. From the knowledge of this codeword and 
the fact that G m in REF was used for encoding, ;he corresponding information 
sequence is easily recovered by taking only the positions which correspond to the 
columns of Ik- Note that this strategy is intuitively correct since whenever a 
code sequence delivered by the decoder is in errc r, the best strategy to recover 
the information bits is simply to determine them independently. Otherwise, 
errors propagate. 
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Example 13.1 In Example 3.1, the TOGM of the (8,4) RM code is given by 


Gt — 


1 1 1 1 0 0 0 0 ' 

0 10 110 10 

0 0 11110 0 

0 0 0 0 1 1 1 1 


After adding rows 2 and 3 to row- 1 , we obtain 


Gm — 


10 0 
0 1 0 
0 0 1 


10 11 
110 1 
1110 


0 0 0 0 1 1 1 


We can readily verify that G t and G m generate the same 16 codewords, so that 
there is a one-to-one correspondence between the codewords generated by G m 
and the paths in the trellis diagram constructed from G t . Once the trellis-based 
decoder delivers the most likely codeword u = (ui,u 2 , . . - ,u 8 ), the correspond- 
ing information sequence a = ( 61 , 02 , 03 , 04 ) is retrieved by identifying 


a 1 

= Ul, 

0,2 

= 

63 

= 63, 

a 4 

= U 8 . 


Figure 13.2 depicts the bit error probabilities for the (32,26) RM code with 
encoding based on the TOGM and the REF matrix, respectively. The corre- 
sponding union bounds obtained in [33] are also shown in this figure. We see 
that there is a gap in error performance of about 1.0 dB and 0.2 dB at the BERs 
10~ 1 ' 5 and 1CT 6 , respectively. Similar results have been observed for other good 
block codes [33, 71). The situation is different for good convolutional codes of 
short to medium constraint lengths, for which the feedforward non-systematic 
realizations outperform their equivalent feedback systematic realizations [80], 
This can be explained by the fact that for short to medium constraint length 
convolutional codes in feedforward form, the bit error probability is dominated 
by error events of the same structures. Due to the small number of such struc- 
tures, an efficient mapping that minimizes the bit error probability can be 
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Figure 13.2. The bit error probabilities for the (32,26) RM code. 
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devised. This is no longer possible when the error performance is dominated 
by numerous unstructured error events, such as for long constraint length good 
convolutional codes or good block codes. 

Based on these results, we may conclude: (1) although modest, the differ- 
ence in bit error performance between encoding with the TOGM and the REF 
is of the same order as the difference in bit error performances between MLD 
and some sub-optimum low- complexity decoding methods; (2) the overall er- 
ror performance of a conventional concatenated scheme with a RS outer code 
performing algebraic decoding is subject to these differences; and most impor- 
tantly (3) the gain is free, since only the encoding circuit and the retrieving 
of the information sequence have to be modified. Furthermore this approach 
can be used for trellis-based MAP or SOVA decodings if a likelihood measure 
associated with each bit of the decoded information sequence, rather than each 
bit of the decoded codeword is needed, as in [34, 39, 40). 

This approach can be generalized to any soft decision decoding method. 
In general, a particular decoding algorithm is based on a particular structure 
of the code considered. For example, majority-logic-decoding of RM codes is 
based on the generator matrices of these codes in their original form (presented 
in Section 2.5), or trellis-based decoding of linear codes is based on the TOGM 
of the code considered. Two cases are possible depending on whether the de- 
coder delivers a codeword as in trellis-based decoding or directly an information 
sequence as in majority-logic-decoding of RM codes. In the first case, the pro- 
cedure previously described is generalized in a straightforward way, while in 
the second case, the row additions performed to obtain Gm from the generator 
matrix corresponding to the decoding method considered are applied to the 
delivered information sequence by the inverse mapper [33]. 



APPENDIX A 

A Trellis Construction Procedure 


To decode a linear block code with a trellis-based decoding algorithm, the 
code trellis must be constructed to be used effectively in the decoding process. 
Therefore, the construction must meet a number of basic requirements. In 
the implementation of a trellis-based decoder, every state in the code trellis is 
labeled. The label of a state is used as the index to the memory where the state 
metric and the survivor into the state are stored. For efficient indexing, the 
sequence required to label a state must be as snort as possible. Furthermore, 
the labels of two states at two boundary locations of a trellis section must 
provide complete information regarding the adjacency of the two states and the 
label of the composite branch connecting the two states, if they are adjacent, 
in a simple way. In general, a composite branch label appears many times 
in a section (see (6.13)). In order to compute the branch metrics efficiently, 
all the distinct composite branch labels in a tnllis section must be generated 
systematically without duplication and stored in a block of memory. Then, for 
each pair of adjacent states, the index to the memory storing the composite 
branch label (or composite branch metric) between the two adjacent states 
must be derived readily from the labels of the two states. To achieve this, 
we must derive a condition that two composite branches have the same label, 
and partition the parallel components in a trellis section into blocks such that 
the parallel components in a block have the same set of composite branch 
labels (see Section 6.4). The composite branch label sets for two different 
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blocks are disjoint. This localizes the composite branch metric computation. 
We can compute the composite branch metrics for each representative parallel 
component in a block independently. In this appendix, we present an efficient 
procedure for constructing a sectionalized trellis for a linear block code that 
meets all the above requirements. The construction makes use of the parallel 
structure of a trellis section presented in Section 6.4. 

A.l A BRIEF REVIEW OF THE TRELLIS ORIENTED GENERATOR 
MATRIX FOR A BINARY LINEAR BLOCK CODE 

We first give a brief review of the trellis oriented generator matrix (TOGM) 
for a binary linear block code introduced in Section 3.4. Let G be a binary 
K x N generator matrix of a binary (N, K) linear code C. For 1 < i < K, let 
ld(») and tr(») denote the column numbers of the leading ‘1’ and the trailing 
T of the t-th row of G, respectively. G is called a TOGM if and only if for 
1 <»<*'< 

ld(0 < ld(i'), (A.l) 

tr(i) ^ tr(t'). (A. 2) 

Let M be a matrix with r rows. Hereafter, for a submatrix M' of M con- 
sisting of a subset of the rows in M, the order of rows in M' is assumed to be 
the same as in M. For a submatrix M' of M consisting of the n-th row, the 

i 2 -th row, . . ., the i p -th row of M, let us call the set {ii, * 2 , - - - .*p} as the row 

number set of M' (as a submatrix of M). M is said to be partitioned into 
the submatrices M u M 2 , . . . , M,, if each row of M is contained in exactly one 
submatrix Mi with 1 < i < n- 

In Section 3.4, a TOGM G of C is partitioned into three submatrices, G]' t , 
G f h , and G' h (also shown in Figure 6.3), for 0 < h < N. The row number sets 
of G r h , G f h , and G a h are {i : tr(i) < h}, {t : h < ld(i)}, {i : ld(t) <h< tr(i)}, 
respectively. G p h and G f u generate the past and future codes at time-h, C 0 ,;. 
and respectively (see Section 3.7). That is, 

Co,,. = r(GS), 

Ci,,n = r ( c ?£), 

where for a matrix M, T(M) denotes the linear space generated by M. 


(A.3) 

(A.4) 
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Since from (A.l) ld(») < ld(i / ) for 1 < i < i* < K y the order of information 
bits corresponds to the order of rows in G, and therefore, the row number sets 
of G£, GJ and G{ as submatrices of G correspond to AJ and A f h (refer 
to Section 3.4), respectively. In this appendix, we put the TOGM in reverse 
direction such that for 1 < i < t' < K, 

Id (i) * ld(i'), (A. 5) 

tr(») > tr(i'). (A.6) 

Using a TOGM in reverse order, we can store the states (or state metrics) at 
the left end of a parallel component in consecutive memory cells using a simple 
addressing method. This method is very useful for designing IC decoder. It 
also reduces the actual computation time for a software decoder, since (the 
metrics of) the states at the left ends are accessed consecutively and computers 
have cache memories. 

For a binary m-tuple u = (ui,u 2l . . . ,u m ) and a set / = {ii,i 2t . of p 
positive integers with 1 < ii < i 2 < * • ■ < i p < rr U define 

p/(u) A (u.^u, u.J. (A. 7) 

For convenience, for 7 = 0, pi(u) = e (the null sequence). For a set U of 
m-tuples, define 

Pl(U)±{pi(u):ueU}. (A. 8) 

For / = {h + l,/i + 2,.. . , h'}, pj is denoted by ph,h f - 

Then, for a partition (Afi, Af 2 , ■ • • , A/,*} of M with r rows and v 6 {0, l} r , 
it follows from the definition of a row number set and (A. 7) that 

vM = pr x (v)Mi + p/ 2 (v)Af 2 + • • +p/ (i (v)Af M , (A. 9) 

where denotes the row number set of Af, foi 1 < i < p. If Af, is further 
partitioned into submatrices Af^, M{ 2 , . . then 

Pi,{v)Mi =p/, l (p/,(w))M il + ?/,,(.*>/. ( w )) M i, + ••» (A. 10) 

where denote the row number sets of Afj,, Mi } , . . . as submatrices 

of 



« 
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In the construction of the trellis section from time-h to time-h', the subma- 
trix G‘ h of G takes a key role. Let I h denote the row number set of G* as a 
submatrix G. Then, ph — |/h|, and the following property of state labeling by 
the state defining information set (Section 4.1) holds. 

The Key Property of State Labeling: Let L(<7o,<T/,,<r/) ^ L(<ro,<rh) 0 
L(( r h ,< 7 /) be the set of paths in a code trellis for C that connects the initial 
state <To to the final state <7/ through the state <tj, at time-h. There is a one- 
to-one mapping l from Ej,(C) to {0, l}*’’* with 0 < h < N such that for 
a*eE h (C)anda€{0,l}*, 

oG e L(<To,<Th,<Tf), (A- 11 ) 

if and only if 

p Ik (a)=l(4 (A. 12) 

AA 

Here, l(tr h ) € {0, l}'”* is called the label of states,,. This state labeling is simply 
the state labeling by the state defining information set given in Section 4.1. We 
can readily see that 

L{(7u,(J}^(7 f) = i(<Jh)G£ 0 Co,/» © Ch,N- (A. 13) 

Note that if ph = 0, G 9 h is the empty matrix and l{&h.) = €■ For convenience, 
we define the product of € and the empty matrix as the zero vector. 

A. 2 STATE LABELING BY THE STATE DEFINING INFORMATION 
SET AND COMPOSITE BRANCH LABEL 

For <r h € E*(C) and c h > € E V (C) with L{a h ,t 7 h >) # 0, the composite branch 
label L( 07 u 0 v) can be expressed in terms of the labels of an and 0V 4 »- Since 

L(crQ,ah,Vh',crf) — L[ao>crh) o L(<7h,07*') o L(a; l »,cr/) 

= L{<jQ,cr h ,Cf) O L(cxo, 0 ^, 07 ), 

it follows from the key property of state labeling that for a € {0, 1}*\ 


clG € L{(Toy iXhi &H 1 » &f) 


(A. 14) 
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if and only if 


pui a ) 


(A. 15) 

p\>( a ) 

= /(<rv)- 

(A. 16) 

Define Ih,h i and ph.v as follows: 

Ih % h* 

= Ih n Ih> 

(A. 17) 

Ph,V 

= \Ih,h'\- 

(A.18) 


Then I^h 1 = {* : ld(t) < h < h' < tr(i)} is the row number set of the submatrix 
of G which consists of those rows in both GJ and G£,. Let GJ^, denote this 
submatrix. Let G a h ' p h , t g£’^, and g{’£, denote the submatrices of G whose row 
number sets as submatrices of G are Ih\Ik,h’ = {* : ld(i) < h < tr(i) < h f } y 
= {* : h < ld(i) < h* < tr(*)} and [i : h < ld(t) < tr(i) < h'}, 
respectively. Then, 

C h , h . = r(G^.), (A. 19) 

and G is partitioned into G£, GJ^ M G^,, g£^,, G£’£, and G^, (see Figure 6.3). 
From (A. 3), (A. 4), (A. 9) and (A. 19), we have that for a € {0,1}*-, aG e C 
can be expressed as 


aG - PV**(°) G fc,v +P/k\/».h-( a ) G h,v + u - (A. 20) 


where u E C 0 ,h © Ch.h' © Gv,//- 

Since h and h' are fixed hereafter, we abbreviate Ph,v(G^,) as G z,y where 
x E {s,/} and y G {s,p}. If aG E £(<ro,<ra,<r/,.,<x/), then p h , h .(oG) = 
aph,h'(G) E L(a h ,crh’)- Since L(tr h ,a h ‘) is a coset in Ph,h'(C)/C% h , (see 
(3.18)), it follows from (A. 20) that 

L(<T h , < Tv) = pr.. fc ,(a)G^*+p /A r vv (a)G^+pr hA r VJk ,(a)GA»+C^,. (A.2I) 


In the following, we will derive a relation between L(ah, &h') and the labels of 
states ah. and ov, /(cr/,) and /(ov)- Lemma A.l gives a simple relation between 
Ih,h> and I h . 

Lemma A.l consists of the smallest ph,h integers in // t . 
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Proof: For » € Ih,h', we have that h! < tr(»). For *' € /a\/j»,v. we have that 
tr(t') < h'. Hence, tr(*') < tr(»). From (A.6), we have * < 

AA 


In general, there is no such a simple relation between Ih,h' and /j»> ■ 

Let I h . = with 1 < »i < »: < • < be the row number 

set of G' h „ and let / h ,v = {*/,,*;, with 1 < >i < >2"- < j Pk , k . < 

p h , be the row number set of <?£*,. By definition, the p-th row of G‘ h , is the 
ip-th row of G for 1 < p < ph' and the p-th row of G£* h , is the » jM -th row of 
G for 1 < p < ph.h 1 ■ Hence, the p-th row of G is the jp-th row of G^, . 
That is, the row number set of G^‘ h , as a submatrix of G£„ denoted J h ., is 
Jh' = {juh,- ■ ■ Jp h . H .b and Jh' = { 1 , 2 , • • • ,Pv} \ Jh' is the row number set 

of G h’,h’- 

Suppose (A. 14) holds. Then, from (A.15), (A.16) and Lemma A.l, 


PV*'( a ) = P-A>( , (' 7 v))> (A.22) 

Pu\u.K'( a ) = p^vmC'N), ( a - 23 ) 

P/ V \; t y(°) = PJ„,(*K'))- ( A - 24 ) 

For simplicity, define 

± po,p^M°»))' ( A - 25 ) 

^ P^^K)), ( A - 26 ) 

/ (,) (ov) - PJ k .(l(°v))> (A-- 27 ) 

1 (/> M £ pjJlM). (A. 28) 

From (A. 25) and (A.26), the label l{a h ) of the state a h with l {3) {<r h ) = a and 
l ip) {&h) = P is given by 

J(<r,0 = ao/3. (A. 29) 


The label l{aw) of the state aw with l {a) {an) = a and l if) {aw) = 7 can be 
easily obtained from a and 7 using (A. 27) and (A. 28). 

By summarizing (A. 14) to (A.16), (A.22) to (A.26) and (A. 28), a condition 
for the adjacency between two states at time-h and time-h f , and the composite 
branch label between them (shown in Section 6.3) are given in Theorem A.l. 
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Theorem A.l For an £ Eh(C) and € E/,'(C7) with 0 < h < h! < N t 
L(<Th,<7h i ) ^ 0 if and only if 

Also if L(cr h ,<7h’) # 0, then L(cr h ,crv) is given by 

L(cr h ,c h .) = l^(* h )G'’’ + lM{<r h )G‘* + /<'>(<t v )G'’« + Cfa,. (A.30) 

AA 

We call l^ s) (<Th) (or /^(ov)) the first label part of (or a^) and ^(ch) 
(or l^(<Th')) the second label part of <Th (or av). Now we partition Eh(C) 
and Ev(C) into blocks of the same size, respectively, in such a way that 
two states are in the same block if and only if they have the same first label 
part. For a € {0, a block, denoted EJ, (or E£) in the above partition 

of Eh(C) (or Eh'(C*)) is defined as 

= {a h eE h (C):/< s >(.x fc ) = a}, (A.31) 

= KsEv(C):i (j) K) = a}. (A.32) 

The blocks E£ and E£, correspond to S^(a^) and Sj?(ah) in Section 6.4, re- 
spectively. That is, for any a € {0, l} p *’ h ', a subgraph which consists of the set 
of state at time-/i, E£, the set of states at time-h', E® , and all the composite 
branches between them form a parallel component. This parallel component is 
denoted A a . The total number of parallel components in a trellis section from 
time-h to time-A' is given by 2 Phh '. 

Since all states in E® U E® have the same fiist label part a, there is a one- 
to-one mapping, denoted s^ Q y from the set ol the second label parts of the 
states in E“, denoted L*, to E£, and there is a one-to-one mapping, denoted 
from the set of the second label parts of the states in E“ , denoted Lu>, 
to E® . Then, L/ t = {0, Lv = {0, l}' and s/ iiQ and sv iQ are 

the inverse mappings of l ^ and l^\ respectively. 

A. 3 TRELLIS CONSTRUCTION 

Now consider how to construct a trellis section. When we use a trellis diagram 
for decoding, we have to store the state metric for each state. Therefore, we 
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must assign memory for each state. For a state we use the label l(<r) as the 
index of the allocated memory, because: (1) l(<r) is the shortest possible label 
for a and is easy to obtain, and (2) as shown in Theorem A.l, the complete 
information on L(<th>c r^) is provided in a very simple way by /W(<r h ), 
lW[p v) and which can be readily derived from l(<Th) and l(ov) by 

(A. 25) to (A. 28). 

If instead we use the state labeling by parity-check matrix for the states at 
time-/i, the label length becomes N — K. Since ps < min{iV, AT— K} (see (5.4)), 
if ph < N — K, a linear mapping from {0, 1} N_ * to {0, 1} P * which depends on 
h in general is necessary to obtain the index of the memory. 

The next problem is how to generate branch metrics of adjacent state pairs 
and give access to them. The set of composite branch labels of the section from 
time-/i to time-h', denoted is the set of the following cosets (see (3.18)): 

U,V=PM'(C)/C JiV (A. 33) 


It follows from (A. 30) that 

L h .h> = {QG 3J + /3G jp + 7G /s + C^ v :a6{0,l}^'-', 

fi 6 {0, 1}'”' 7 € {0, ( A . 34) 

Each composite branch label appears 

2#f-fc(C 0 ,fc)-lt(C Jk , > .v)-fc(Ph.v(C)) 

times in the trellis section (see (6.13)). 

Next we consider how to generate all the composite branch labels in Lh t h' 
given by (A. 34) without duplication. Suppose we choose submatrices G a { 9 of 
G s ' s y G[' p of G 3 p and G{ 9 of G f ' 9 such that the rows in G 9 { p y Cl 9 and 
G^ p are linearly independent and 

L h , h > = {q 1 G s,j + f3 1 G‘ , ‘ + 7iG^’* + : a i £ {0, 

fix e{0,ir* ',7i €{0,l} r '-}. (A. 35) 

where r a p and r f , denote the numbers of rows of G\'* , G\' p and G{’*, 
respectively. If we generate composite branch labels by using the right-hand 
side of (A. 35) and store ciiG 3 - 3 +fi 1 G* p +7 l G / ’ 3 + C} l T h , into a memory indexed 
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with then the duplication can be avoided. The next requirement is 

that the index (aq , /3 t , ) can be readily obtained from a, (3 and 7. To provide 

a good solution of the above problem, we first analyze the linear dependency 
of rows in pa, h'(G). 

For a TOGM G, Ph,v(G) consists of the disjoint submatrices G* ,J , G ,,p , 
GA j } G f p and the all zero submatrices P\v(G£) and PM'(G£,). 

Lemma A. 2 In ph,v(G): (1) the rows in submatrices G*' 9 and G ftP are lin- 
early independent; and (2) the rows in submatrices G*’ p and G f p are linearly 
independent. 

Proof: If the i-th row of G is in G?' 9 or G^ iP , then 

h < ld(t) < ti. (A. 36) 

Similarly, if the i-th row of G is in G 9tP or G*' p , then 

h < tr(i) < ti. (A. 37) 

Hence, (1) and (2) of the lemma follow from (A.l) and (A. 2), respectively. 

A A 

For two binary r x m matrices M and M f and a binary linear block code C 0 
of length m, we write 

M = M f (modC’o) 

if and only if every row in the matrix M - Af' it in C 0 , where W - M denotes the 
component-wise subtraction. 

Partition G^ 9 into two submatrices Gjj' a and G{ ,s (see Figure A.l) by par- 
titioning the rows of G^ 9 in such a way that 

(1) the rows in G{'\ G 9p and G^ p are linearly independent, and 

(2) each row of G^' 3 is a linear combination of rows in G[' a y G 9 ' p and G^ p . 

Let v x denote the number of rows of G( ,a , and define u Q = p h * — p h v - i/ ly 
which is the number of rows of G^' 3 . 

Let Ci, ei, . . . , e„ 0 be the first to the last rov s of G l' 3 . From conditions ( 1) 
and (2) of the partitioning of G f a y there are unique v| x) £ {0, l}* 1 , v| 2) £ 
{0, l} Pfc “ p A.A' and Ui £ C£ h , such that 

e, = v^G^ + u^G^-f ti*, for 1 < i < u 0 . 
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G'-‘ 
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G* 1 * Ph.V 


> G ! '‘ Ph' ~ Ph.h’ 


G*’P Ph ~ Ph,h' 




Figure A.l. Further partitioning of the TOGM G. 

Let E {1) denote the t/ 0 x vi matrix whose i-th row is vj 1 * and E {2) denote the 
t/ 0 x (ph - Ph.h') matrix whose t-th row is v\ Then, we have 

G{' 3 = E {1) G { ’* + E {2) G a ' p (mod C£ h> ). (A.38) 

Gj['\ G{'“, 2s ( 1) and E (2) can be efficiently derived by using standard row 
operations. 

Next, partition G 5J into two submatrices Gj >J * and Gj ,J (see Figure A.l) by 
partitioning the rows of G 3 S in such a way that: 

(1) the rows in G‘{‘, G{ ‘, G ap and G fp are linearly independent; and 

(2) each row of G^’* is a linear combination of rows in GJ’*, G{’ s , G ap and 
G /p . 
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Let Ai denote the number of rows of G {’*, and define A 0 — ph,h' — A,, which 
is the number of rows of GJ’*. In a similar way as the derivation of (A. 38), 
we can find a unique Ao x Ai matrix F* 1 ', a unique Ao x v\ matrix and a 
unique Ao x (pi, — ph,h') matrix such that 

Gj’* = F ( 1 , GI* J + F {2) G{’* + F ( 3 ) G" p (modC^ h ,)- (A.39) 

Let R and Q denote the row number sets of G{’* and Gj’*, respectively. Define 
R ^ { 1 , 2 ,... ,pv - p h ,h‘}\R and Q = { 1,2 ,p h ,h'}\Q- Then, from (A.9) 

ocG *•' — pq(oc)Go 1 +pQ(a)G’ ,s t for a e {0, 1 } Pn ’ 1 ', (A. 40) 

7 G f, ‘ = PA( 7 )Go’*+P«( 7 )Gf’*, for 7 € {0, l} < ’»'~ p *.*' > (A.41) 

It follows from (A. 38) to (A.41) that for a € {0, l}'’*-’*', /3 € {0, l}''’ 1- '’ 
and 7 € {0, l} p k'- p *.»', 

aG 5 ’* + /3G ,,P + tGA* + c£ v 
= (p Q (a)+ P( 5 (a)F< 1 ))Gr 

+ ( Pl j(a)F^ + Pk (~f)E^ +0)G’-r 

+ M<*)F <2) +P«(7) +Pfi(7)F ll) )Gf' a + (A. 42) 

Define 

/ (I) (a) = p Q (a) +P(5(a)F (1) , (A.43) 

7) = p^(a)F (3) +p A (7)F (2) +/9, (A.44) 

/ (3) (q,7) ^ p<5(a)F (2) +pfl(7)+p ft (7)F (1) . (A.45) 

When a, (3 and 7 run over {0, {0, 1 } P * and {0, re . 

spectively, / (1) (a) /< 2) (a,/ 3,7) and / (3) (a,7) n n over {0, l} Al , {0, *' 
and {0, l} 1 "*, respectively. Hence, the set L^h* all composite branch labels 
is given by 

Lk# = {a 1 G{’*+/3 1 G«' p + 7 1 Gf’ J f G‘V: 

a, 6 {O.l}* 1 ,^ € {0,1} P< * p * *', 7 1 € {0,1}-}. (A. 46) 

Since the rows in G’’*, G a,p , G{’* and G^ ,p ire linearly independent, for 
/ (ai,/9 , x,7'i), the cosets qjGJ'* + y3 1 G > ' p + 7 jG{’* + C^ r h> and 
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cr'iCr +0! G 9p + 7 , 1 G{ j + C% h , are disjoint. Consequently, the set of com- 
posite branch labels of a parallel component A a with a € {0, denoted 

is given by 

L a ± {a 1 G s l ' , +p l G 3 ” + ll G f l - , +C\: ih .: 

/3j e {0,1}'* 7i € {0,1}-}, (A.47) 

where ai = f^(a) — Pq{cx) + P^oOF* 1 *. 

Theorem A.2 Let Q denote the row number sets of Gj’ a , and define Q = 
{1,2,..., p/i,v} \ Q • Two parallel components A a and A a » with a and a' in 
{0, l} Phh ' are isomorphic up to composite branch labels, if and only if 

p Q (a + a') = (p< 5 (a + a'))F (1) . (A.48) 

where F ^ is defined in (A. 39). If (A.48) does not hold, L a and L a * are 
disjoint. 

Proof: (1) The only-if part: If ai = Pq(o) + P(j(q)F ( 1) ^ «i = Pq{q') + 
Pg(a')F (1) , then L a and L a ■ are mutually disjoint from (A.47). 

(2) The if part: Suppose that (A.48) holds, that is, otj = otj. Let l a +a' denote 
the binary (p h < - p h .v)-tuple such that 

Pk(/o + o')=Pq(« + «')F (2 \ (A. 49) 

p ft (/ 0+0 .) = 0. (A. 50) 

For any given state pair (cta,^.) eE“ x , define (xrj,,^,) € x E“ as 

l ( *»K) = /' p) (a h )+p ( j(a + a')F( : », 

i.e.,^ = s h . Q .(I (p) K)+Po(« + «')F (3) ), (A.51) 
,.) = ft/) (er/i' ) + f Q +<*s 

i.e, aj,. = s h ',a'{l {{) {vh') 4“ ^a+a ' )■ (A. 52) 

Then, / (1, (o) = / (1) (a'), = /< 2 >(aV (p, K). 

l {f) {<y' h ,)) and /< 3) (a,i (/) (<Tv)) = /t 3) (a',/ (/) «,)). Hence, it follows from 
(A. 30), and (A.42) to (A.45) that 

L(a h ,a h >) = L(a' h ,a' h ,). 
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Note that when <7/, runs over E®, /^(<7h) runs over Lu = {0,1}^”^.*' and 
therefore, Sk f0t *(l( p )(<r h ) + p < j(a + a')F (3 )) defines a permutation of E£\ Sim- 
ilarly, 8h\*»(l^(0h 9 ) + *a+a') defines a permutation of E£,\ 

AA 

Corollary A.l The block of the isomorphic parallel components containing 
A a is given by 

{Ao+a* : Pq(q') = Pq(cx')F 1i) ,p ( ? (a') € {0, 1}*°}. (A.53) 

Each block of the petition consists of 2 A ° identical parallel components, where 
Ao is the number of rows of G 

AA 

It is shown in [44] that A 0 is equal to A^v(C') defined by (6.36). 

Example A.l Consider the RM 3 ,e code which is a (64,42) code. The second 
section of the 8-section minimal trellis diagram T({0, 8, 16, . . . , 64}) for this 
code consists of 16 parallel components, and they are partitioned into two 
blocks. Each block of the partition consists of 2 3 identical parallel components, 
Each parallel components has 8 states at time 3 and 64 states at time 16. 
Hence, there are 2 13 = 16 x 8 x 64 composite branches in this trellis section. 
However, there are only 2 10 = 2 x 8 x 64 different composite branch labels. 

AA 


A. 4 AN EFFICIENT TRELLIS CONSTRUCTION PROCEDURE 

In this section, an efficient procedure for constructing the trellis section from 
time-h to time-h' is presented. First, we present a subprocedure, denoted 
GenerateCBL(a), that generates the set of composite branch labels for a 
representative parallel component A a in a block. From Corollary A.l, we can 
choose the parallel component A Q with p^(a) = 0 as the representative (in 
(A.53), for any a, A a + Q ' with p^a') = p$(a) is such one). Let = p Q (a). 
Then, the subprocedure, GenerateCBL^), geneiates the set of the composite 
branch labels of the parallel component A a , denoted L ai : 

La, = {a 1 Gj’* + 7l Gf-* + ^G*" + C^,: 

7i € {0 1 l} t M3 6 0,l}' , ‘-' , ‘v} i 



270 TRELLISES AND TRELLIS-BASED DECODING ALGORITHMS FOR LINEAR BLOCK CODES 


and stores each composite branch label c*i G[* a + 7 1 G{ ,j +/3G*» P + C£ v , in the 
memory at the index aioy x ofi. This makes it possible to store the composite 
branch labels in the parallel component at consecutive memory locations. 

It follows from (A. 42) that for G £“ and G with = a, 

= 0 and = 7 , the composite branch label, £(<Xh,<rv) = 

aG * ’* + 7 G?'* + / 3 G 5 ’ p + C£ h , (or the maximum metric of L(o 7 i,<rv)) is stored 
in the memory with the following index: 

indx(a,/3,7) = (p«?(a) + p< 5 (a)F (1) ) o (p$(a)F (2) + p«(7) + Pa(7)F U) ) 

o(p <5 (a)F (3) + Pa ( 7)£ (j) + P). (A. 54) 


[Trellis Construction Procedure Using Isomorphic Parallel Compo- 
nents] 

For every c*i € { 0 , l} Al { 

Construct L 0l , by executing GenerateCBL(ai). 

(* Construct isomorphic parallel components. *) 

For every ao € { 0 , 1 } A ° { 

Let a be an element in {0, l} pHh ' such that 

p Q (a) = c*i + a 0 F {l) y and Pcj( a ) = a o- 

Construct A a by executing Construct A(a) subprocedure stated below. 

} 

} 

AA 

The following subprocedure Construct A(a) to construct A (a) is one to list 
(/(<rfc).i(»fc-),indx(i (,, («rh)./ w M,I (/> K))) 

for every state pair (<7h,0v) G E£ x E® . 

Subprocedure ConstructA(a): 

(* Construct a parallel component A a . *) 

For every 7 G {0, { 

For every (3 G {0 t { 
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Output (/(sh, a (/3)),/(sv,ci(7)).indx(c,/8,7)). 

} 

} 

AA 

Note that the labels, f(s/, ia (/3)), /(sv, a (7)) and indx(a,/3,7) are given by 
(A. 29), (A.27) and (A.28), and (A. 54), respectively. 



REFERENCES 


[1] L.R. Bahl, J. Cocke, F. Jelinek, and J. Raviv, “Optimal decoding of linear 
codes for minimizing symbol error rate," IEEE Trans. Inform. Theory, 
vol. IT-20, pp. 284-287, 1974. 

[2] A.H. Banihashemi and I.F. Blake, “Trellis complexity and minimal trellis 
diagrams of lattices,” IEEE Trans. Inform. Theory, submitted for publi- 
cation, 1996. 

[3] G. Battail, “Ponderation des symboles decodes par Talgorithm de 
Viterbi,” Ann. Teiecomniun., vol. 42, pp. 31-38, 1987. 

[4] E. Berlekamp, Algebraic Coding Theory , Agean Park Press, Laguna Hills, 
Revised edition, 1984. 

[5] Y. Berger and Y. Be’ery, “Bounds on the trellis size of linear block codes,” 
IEEE Trans. Inform. Theory , vol.39, pp.203-209, 1993. 

[6] Y. Berger and Y. Be’ery, “Soft trellis-based decoder for linear block 
codes,” IEEE Trans. Inform. Theory , vol. 40, pp.764-773, 1994. 

[7] Y. Berger and Y. Be’ery, “Trellis-oriented decomposition and trellis- 
complexity of composite length cyclic codes,” IEEE Trans . Inform. The- 
ory, vol. 41, pp. 1185-1 191, 1995. 


273 




274 TRELLISES AND TRELLIS-BASED DECODING ALGORITHMS FOR LINEAR BLOCK CODES 


[8] Y. Berger and Y. Be’ery, “The twisted squaring construction, trellis com- 
plexity and generalized weights of BCH and QR codes, 11 IEEE Trans. In- 
form. Theory , vol.42, pp.1817-1827, 1996. 

[9] C.Berrou, P.Adde, E.Angui and S.Faudeil, “A low complexity soft-output 
Viterbi decoder architecture,” in Proc. of ICC , pp.737-740, 1993. 

[10] P.J. Black and T.H. Meng, “A 140-Mb/s, 32-state, radix-4, Viterbi de- 
coder,” IEEE J. Solid-State Circuits , vol.27, December 1992. 

[11] R.E. Blahut, Theory and Practice of Error Correcting Codes , Addition- 
Wesley, Reading MA, 1984. 

[12] I.F. Blake and V. Tarokh, “On the trellis complexity of the densest lattice 
packings in H r \” SIAM J. Discrete Math., vol.9, pp.597-601, 1996. 

[13] A.R. Calderbank, “Multilevel codes and multi-stage decoding,” IEEE 
Trans. Commun., vol.37, no. 3, pp. 222-229, March 1989. 

[14] D. Chase, “A class of algorithms for decoding block codes with channel 
measurement information,” IEEE Trans. Inform. Theory, vol.18, no.l, 
pp. 170-181, January 1972. 

[15] J.F. Cheng and R.J. McEliece, “Near capacity codes for the Gaussian 
channel based on low-density generator matrices,” in Proc. 34-th Allerton 
Conf. on Comm., Control, and Computing , Monticello, IL., pp. 494-503, 
October 1996. 

[16] G.C. Clark and J.B. Cain, Error Correcting Codes for Digital Commu- 
nications , Plenum Press, New York, 1981. 

[17] Y. Desaki, T. Fujiwara and T. Kasami, “A Method for Computing the 
Weight Distribution of a Block Code by Using Its Trellis Diagram,” IE- 
ICE Trans. Fundamentals , vol.E77-A, no. 8, pp. 1230-1237, August 1994. 

[18] S. Dolinar, L. Ekroot, A.B. Kiely, R.J. McEliece, and W. Lin, “The per- 
mutation trellis complexity of linear block codes,” in Proc. 32-nd Aller- 
ton Conf. on Comm., Control , and Computing, Monticello, IL., pp. 60-74, 
September 1994. 



REFERENCES 275 


[19] A. Engelhart, M. Bossert, and J. Maucher, “Heuristic algorithms for or- 
dering a linear block code to reduce the number of nodes of the minimal 
trellis,” IEEE TVans. Inform . Theory , submitted for publication, 1996. 

[20] J. Feigenbaum, G.D. Forney Jr., B.H. Marcus, R.J. McEliece, and 
A. Vardy, Special issue on “Codes and Complexity,” IEEE TVans. In- 
form . Theory , vol.42, November 1996. 

[21] G. Fettweis and H. Meyr, “Parallel Viterbi algorithm implementation: 
breaking the ACS-bottleneck,” IEEE TVans. Com/nuu., vol.37, no. 8, 
pp. 785-789, August 1989. 

[22] G.D. Forney Jr. t Concatenated Codes , MIT Press, Cambridge, MA, 1966. 

[23] G.D. Forney Jr., “The Viterbi algorithm,” Proc. IEEE, vol.61, pp.268- 
278, 1973. 

[24] G.D. Forney Jr., “Coset codes II: Binary lattices and related codes,” 
IEEE Trans. Inform. Theory, vol.34, pp. 1152-1 187, 1988. 

[25] G.D. Forney Jr., “Dimension/length profiles and trellis complexity of 
linear block codes,” IEEE Trans. Inform. Theory, vol.40, pp. 1741-1752, 
1994. 

[26] G.D. Forney Jr., “Dimension/length profiles and trellis complexity of 
lattices,” IEEE Trans. Inform . Theory , vol.40, pp. 1753-1772, 1994. 

[27] G.D. Forney Jr., “The forward- backward a gorithm,”in Proc. 34-th Aller - 
ton Conf '. on Comm., Control , and Compu ting, Control, and Computing , 
Monticello, IL., pp. 432-446, October 1996 

[28] G.D. Forney, Jr. and M.D. Trott, “The dynamics of group codes: 
state spaces, trellis diagrams and canonical encoders,” IEEE Trans. In- 
form. Theory , vol.39, pp. 1491-1513, 1993. 

[29] G.D. Forney, Jr. and M.D. Trott, “The cynamics of group codes: dual 
group codes and systems,” preprint. 



276 TRELLISES AND TRELLIS-BASED DECODING ALGORITHMS FOR LINEAR BLOCK CODES 


[30] M.P.C. Fossorier and S. Lin, “Coset codes viewed as terminated convo- 
lutional codes,” IEEE Trans. Comm., vol.44, pp. 1096—1 106, September 
19%. 

[31] M.P.C. Fossorier and S. Lin, “Some decomposable codes: the |a + x|6 + 
x|a + b 4- x| construction,” IEEE Trans. Inform. Theory , vol. IT-43, 
pp. 1663-1667, September 1997. 

[32] M.P.C. Fossorier and S. Lin, “Differential trellis decoding of conventional 
codes,” IEEE Trans. Inform. Theory , submitted for publication. 

[33] M.P.C. Fossorier, S. Lin, and D. Rhee, “Bit error probability for max- 
imum likelihood decoding of linear block codes,” in Proc. Internationa] 
Symposium on Inform. Theory and its Applications , Victoria, Canada, 
pp. 606-609, September 1996, and submitted to IEEE TVa ns. Inform . The- 
ory \ June 1996. 

[34] M.P.C. Fossorier, F. Burkert, S. Lin, and J. Hagenauer, tt 0n the equiva- 
lence between SOVA and Max-Log-MAP decoding,” IEEE Comm . Let- 
ters, submitted for publication, August 1997. 

[35] B.J. Frey and F.R. Kschischang, “Probability propagation and iterative 
decoding,” in Proc. 34-th Allerton Conf. on Comm., Control and Com- 
puting Monticello, IL., pp. 482-493, October 1996. 

[36] T. Fujiwara, T. Kasami, R.H. Morelos-Zaragoza, and S. Lin, “The state 
complexity of trellis diagrams for a class of generalized concatenated 
codes,” in Proc. 1994 IEEE International Symposium on Inform . The- 
ory , Trondheim, Norway, p.471, June/July, 1994. 

[37] T. Fujiwara, H. Yamamoto, T. Kasami, and S. Lin, “A trellis-based re- 
cursive maximum likelihood decoding algorithm for linear codes,” IEEE 
Trans. Inform. Theory , vol.44, to appear, 1998. 

[38] P.G. Gulak and T. Kailath, “Locally connected VLSI architectures for the 
Viterbi algorithms,” IEEE J. Select Areas Commun vol. 6, pp. 526-637, 
April 1988. 



REFERENCES 277 


[39] J. Hagenauer and P. Hoeher, “A Vitcrbi algorithm with soft-decision out- 
puts and its applications,” in Proc. IEEE Globecom Conference , Dallas, 
TX, pp. 1680-1686, November 1989. 

[40] J. Hagenauer, E. Offer, and L. Papke, “Iterative decoding of binary block 
and convolutional codes,” IEEE Trans. Inform . Theory , vol.42, pp.429- 
445, March 1996. 

[41] B. Honary and G. Markarian, Trellis decoding of block codes : a practical 
approach , Kluwer Academic Publishers, Boston, MA, 1997. 

[42] G.B. Horn and F.R. Kschischang, “On the intractability of permuting a 
block code to minimize trellis complexity,” IEEE Tka ns. Inform. Theory , 
vol.42, pp. 2042-2048, 1996. 

[43] H. Imai and S. Hirakawa, “A new multilevel coding method using error 
correcting codes,” IEEE Trans. Inform. Theory , vol.23, no. 3, May 1977. 

[44] T. Kasami, T. Fujiwara, Y. Desaki, and S. Lin, “On branch labels of 
parallel components of the L-section minimal trellis diagrams for bi- 
nary linear block codes,” IEICE Trans. Fundamentals , vol.E77-A, no. 6 , 
pp. 1058-1068, June 1994. 

[45] T. Kasami, T. Takata, T. Fujiwara, and S. Lin, “On the optimum bit 
orders with respect to the state complexity of trellis diagrams for binary 
linear codes,” IEEE Trans. Inform Theory , vol.39, no.l, pp. 242-243, Jan- 
uary 1993. 

[46] T. Kasami, T. Takata, T. Fujiwara, and S. Lin, “On complexity of trellis 
structure of linear block codes,” IEEE Trans. Inform. Theory , vol.39, 
no. 3, pp. 1057-1064, May 1993. 

[47] T. Kasami, T. Takata, T. Fujiwara, and S. Lin, “On structural complexity 
of the L-section minimal trellis diagrams or binary linear block codes,” 
IEICE Trans. Fundamentals , vol.E76-A, ro.9, pp. 1411-1421, September 
1993. 

[48] T. Kasami, T. Koumoto, T. Fujiwara, H. Yamamoto, Y. Desaki and 
S. Lin. “Low weight subtrellises for binary linear block codes and their 



278 TRELLISES AND TRELLIS-BASED DECODING ALGORITHMS FOR LINEAR BLOCK CODES 


applications” IEICE IVans. Fundamentals, vol.E80-A , no.ll, pp.2095- 
2103, November 1997. 

[49] T. Kasami, T. Sugita and T. Fujiwara, “The split weight 
enumeration of Reed-Muller codes for wl -f t vr < 2d mm ” in Lecture 
Notes in Comput . Sci . (Proc. 12th International Symposium t AAECC- 
12), vol.1255, pp. 197-211, Springer- Verlag, June 1997. 

[50] T. Kasami, H. Tokushige, T. Fujiwara, H. Yamamoto and S. Lin, tt A re- 
cursive maximum likelihood decoding algorithm for Reed-Muller codes 
and related codes,” Technical Report of NAIST , no.NAIST-IS-97003, 
January 1997. 

[51] A.B. Kiely, S. Dolinar, R.J. McEliece, L. Ekroot, and W. Lin, “Trellis 
decoding complexity of linear block codes,” IEEE Trans . Inform . Theory, 
vol.42, pp. 1687-1697, 1996. 

[52] T. Komura, M. Oka, T. Fujiwara, T. Onoye, T. Kasami, and S. Lin, 
“VLSI architecture of a recursive maximum likelihood decoding algo- 
rithm for a (64, 35) subcode of the (64, 42) Reed-Muller code,” in Proc. In- 
ternational Symposium on Inform. Theory and Its applications, Victoria, 
Canada, pp. 709-712, September 1996. 

[53] A.D. Kot and C. Leung, M On the construction and dimensionality of 
linear block code trellises,” in Proc. IEEE Int. Symp. Inform. Theory , 
San Antonio, TX., p.291, 1993. 

[54] F.R. Kschischang, “The combinatorics of block code trellises,” in Proc. 
Biennia] Symp. on Commun ., Queen’s University, Kingston, ON., 
Canada, May 1994. 

[55] F.R. Kschischang, “The trellis structure of maximal fixed-cost codes,” 
IEEE Trans . Inform . Theory , vol.42, pp.1828-1838, 1996. 

[56] F.R. Kschischang and G.B. Horn, “A heuristic for ordering a linear 
block code to minimize trellis state complexity,” in Proc . 32-nd Aller - 
ton Conf. on Comm., Control , and Computing , pp. 75-84, Monticello, 
IL., September 1994. 



REFERENCES 279 


[57] F.R. Kschischang and V. Sorokine, u On the trellis structure of block 
codes,” IEEE Trans . Inform. Theory , vol.41, pp. 1924- 1937, 1995. 

[58] A. Lafourcade and A. Vardy, “Asymptotically good codes have infi- 
nite trellis complexity,” IEEE Trans. Inform . Theory , vol.41, pp. 555-559, 
1995. 

[59] A. Lafourcade and A. Vardy, “Lower bounds on trellis complexity of block 
codes,” IEEE Trans. Inform. Theory , vol.41, pp.1938-1954, 1995. 

[60] A. Lafourcade and A. Vardy, “Optimal sect ionaiizat ion of a trellis,” IEEE 
Trans. Inform. Theory, vol.42, pp.689-703, 1996. 

[61] L. Lin and R.S. Cheng, “Improvements in SOVA-based decoding for turbo 
codes,” Proc. of ICC, pp. 1473-1478, 1997. 

[62] S. Lin and D.J. Costello, Jr., Error Control Coding : Fundamentals and 
Applications , Prentice Hall, Englewood Cliffs, NY, 1983. 

[63] S. Lin, G.T. Uehara, E. Nakamura, and W.P. Chu, “Circuit design ap- 
proaches for implementation of a subtrellis IC for a Reed-Muller sub- 
code,” NASA Technical Report 96-001, February 1996. 

[64] C.C. Lu and S.H. Huang, “On bit-level trellis complexity of Reed-Muller 
codes,” IEEE Trans . Inform. Theory , vol.^1, pp.2061-2064, 1995. 

[65] H.H. Ma and J.K. Wolf, “On tail biting convolutional codes,” IEEE 
Trans. Commun., vol.34, pp. 104-1 11, 1986. 

[66] F.J. MacWilliams and N.J.A. Sloane, The Theory of Error Correcting 
Codes , North-Holland, Amsterdam, 1977. 

[67] J.L. Massey, “Foundation and methods cf channel encoding,” in Proc. 
Int. Conf. Inform. Theory and Systems , NTG-Fachberichte, Berlin, 1978. 

[68] J.L. Massey and M.K. Sain, “Inverses of linear sequential circuits,” IEEE 
Trans. Computers , vol. COMP-17, pp. 330- 337, April 1968. 

[69] R.J. McEliece, “On the BCJR trellis for linear block codes,” IEEE 
Trans. Inform. Theory , vol.42, pp.l072-l( 92, 1996. 



280 TRELLISES AND TRELLIS-BASED DECODING ALGORITHMS FOR LINEAR BLOCK CODES 


[70] R.J. McEliece and W. Lin, “The trellis complexity of convolutional 
codes,” IEEE Trans. Inform. Theory, vol.42, pp. 1855-1864, 1996. 

[71] A.M. Michelson and D.F. FYeeman, “Viterbi decoding of the (63,57) 
Hamming codes — Implementation and performance results,” IEEE 
Trans. Comm., vol.43, pp. 2653-2656, 1995. 

[72] H.T. Moorthy and S. Lin, “On the labeling of minimal trellises for linear 
block codes,” in Proc. International Symposium on Inform. Theory and 
its Applications, Sydney, Australia, vol.l, pp.33-38, November 20-24, 
1994. 

[73] H.T. Moorthy, S. Lin, and G.T. Uehara, “Good trellises for IC implemen- 
tation of Viterbi decoders for linear block codes,” IEEE Trans. Comm., 
vol.45, pp. 52-63, 1997. 

[74] H.T. Moorthy and S. Lin, “On the trellis structure of (64,40,8) subcode 
of the (64, 42, 8) third-order Reed-Muller code," NASA Technical Report, 
1996. 

[75] H.T. Moorthy, S. Lin, and T. Kasami, “Soft-decision decoding of bi- 
nary linear block codes based on an iterative search algorithm, IEEE 
Trans. Inform. Theory, vol.43, no.3, pp. 1030-1040, May 1997. 

[76] R.H. Morelos-Zaragoza, T. Fujiwara, T. Kasami, and S. Lin, “Construc- 
tions of generalized concatenated codes and their trellis-based decod- 
ing complexity,” IEEE Trans. Inform. Theory, submitted for publication, 
1996. 

[77] D.J. Muder, “Minimal trellises for block codes," IEEE Trans. In- 
form. Theory, vol.34, pp. 1049-1053, 1988. 

[78] D.E. Muller, “Application of Boolean algebra to switching circuit design 
and to error detection,” IEEE Trans. Computers, vol.3, pp.6— 12, 1954. 

[79] J.K. Omura, “On the Viterbi decoding algorithm,” IEEE Trans. In- 
form. Theory, vol. IT-15, pp. 177-179, 1969. 

[80] L.C. Perez, “Coding and modulation for space and satellite communica- 
tions,” Ph.D Thesis, University of Notre Dame, December 1994. 




REFERENCES 281 


[81] W.W. Peterson and E.J. Weldon, Jr., Error Correcting Codes, 2nd edi- 
tion, MIT Press, Cambridge, MA, 1972. 

[82] J.G. Proakis, Digital Communications, 3rd edition, McGraw-Hill, New 
York, 1995. 

[83] I.S. Reed, “A class of multiple-error-correcting codes and the decoding 
scheme," IEEE Trans. Inform. Theory, vol.IT-4, pp.38-49, 1954. 

[84] I. Reuven and Y. Be’ery, “Entropy /length profiles and bounds on trellis 
complexity of nonlinear codes,” IEEE Trans. Inform. Theory, submitted 
for publication, 1996. 

[85] D. Rhee and S. Lin, “A low complexity and high performance concate- 
nated scheme for high speed satellite communications,” NASA Technical 
Report, October 1993. 

[86] R.Y. Rubinstein, Simulated and the Monte Carlo Method, New York, 
Wiley, 1981. 

[87] G. Schnabl and M. Bossert, “Soft decision decoding of Reed-Muller codes 
and generalized multiple concatenated codes,” IEEE Trans. Inform. The- 
ory, vol.41, no.l, pp. 304-308, January 1995. 

[88] P. Schuurman, “A table of state complexity bounds for binary linear 
codes,” IEEE Trans. Inform. Theory, vol.42, pp.2034-2042, 1996. 

[89] V.R. Sidorenko, “The minimal trellis has maximum Euler characteristic 
|Y| — | E\." Problemy Peredachi Informatsii, to appear. 

[90] V.R. Sidorenko, G. Markarian, and B. Honary, “Minimal trellis design 
for linear block codes based on the Shannon product,” IEEE Trans. In- 
form. Theory, vol.42, pp. 2048-2053, 1996. 

[91] V.R. Sidorenko, I. Martin, and B. Honary, “On separability of nonlinear 
block codes,” IEEE Trans. Inform. Theory, submitted for publication, 
1996. 

[92] G. Solomon and H.C.A. van Tilborg, “A connection between block and 
convolutional codes,” SIAM J. Appl. Math., vol.37, pp. 358— 369, 1979. 



282 TRELLISES AND TRELLIS-BASED DECODING ALGORITHMS FOR LINEAR BLOCK CODES 


[93] V. Sorokine, F.R. Kschischang, and V. Durand, “Trellis-based decoding 
of binary linear block codes,” in Lecture Notes in Comput. Sci. ( Proc . 3rd 
Canadian Workshop on Inform . Theory), vol.793, pp.270-286, Springer- 
Verlag, 1994. 

[94] D.J. Taipale and M.B. Pursley, “An improvement to generalized min- 
imum distance decoding,” IEEE 7Va ns. Inform . Theory , vol.37, no.l, 
pp. 167-172, 1991. 

[95] T. Takata, S. Ujita, T. Kasami, and S. Lin, “Multistage decoding of 
multilevel block M-PSK modulation codes and it performance analysis,” 
IEEE Trans. Inform. Theory , vol.39, no.4, pp. 1024-12 18, 1993. 

[96] T. Takata, Y. Yamashita, T. Fujiwara, T. Kasami, and S. Lin, “Subopti- 
mum decoding of decomposable block codes,” IEEE IVans. Inform . The- 
ory, vol.40, no. 5, pp. 1392-1405, 1994. 

[97] V. Tarokh and I.F. Blake, “Trellis complexity versus the coding gain of 
lattices I,” IEEE Trans. Inform. Theory , vol.42, pp. 1796-1807, 1996. 

[98] V. Tarokh and I.F. Blake, “Trellis complexity versus the coding gain of 
lattices II,” IEEE Trans. Inform. Theory , i ol.42, pp. 1808-1816, 1996. 

[99] V. Tarokh and A. Vardy, “Upper bounds on trellis complexity of lattices,” 
IEEE Trans. Inform. Theory , vol.43, pp. 1294-1300, 1997. 

[100] H. Thapar and J. Cioffi, “A block processing method for designing high- 
speed Viterbi detectors,” in Proc . ICC, vo!.2, pp.1096-1100, June 1989. 

[101] H. Thirumoorthy, “Efficient near-optimum decoding algorithms and trel- 
lis structure for linear block codes,” Ph.D dissertation, Dept, of Elec. En- 
grg., University of Hawaii at Manoa, November 1996. 

[102] A. Vardy and Y. Be’ery, “Maximum-likelihood soft decision decoding of 
BCH codes,” IEEE Trans. Inform. Theory vol.40, pp. 546-554, 1994. 

[103] A. Vardy and F.R. Kschischang, “Proof o * a conjecture of McEliece re- 
garding the expansion index of the minimal trellis,” IEEE Trans. In- 
form. Theory , vol.42, pp. 2027-2033, 1996. 



REFERENCES 283 


[104] V.V. Vazirani, H. Saran, and B. Sunder Rajan, 41 An efficient algorithm 
for constructing minimal trellises for codes over finite abelian groups,” 
IEEE Trans. Inform . Theory , vol.42, pp. 1839-1854, 1996. 

[105] A,J. Viterbi, “Error bounds for convolutional codes and asymptotically 
optimum decoding algorithm," IEEE Trans. Inform. Theory , vol.IT-13, 
pp. 2 60-269, 1967. 

[106] Y.-Y. Wang and C.-C. Lu, “The trellis complexity of equivalent binary 
(17,9) quadratic residue code is five,” in Proc. IEEE Int. Symp. In- 
form. Theory , San Antonio, TX., p.200, 1993. 

[107] Y.-Y. Wang and C.-C. Lu, “Theory and algorithm for optimal equivalent 
codes with absolute trellis size,” preprint. 

[108] X.A. Wang and S.B. Wicker, “The design and implementation of trellis 
decoding of some BCH codes,” IEEE Trans. Commun ., submitted for 
publication, 1997. 

[109] J.K. Wolf, “Efficient maximum-likelihood decoding of linear block codes 
using a trellis,” IEEE Trans. Inform. Theory , vol.24, pp. 76-80, 1978. 

[110] J. Wu, S. Lin, T. Kasami, T. Fujiwara, and T. Takata, “An upper bound 
on effective error coefficient of two-stage decoding and good two level 
decompositions of some Reed-Muller codes,” IEEE Thans. Comm., vol.42, 
pp. 813-818, 1994. 

[111] H. Yamamoto, “Evaluating the block error probability of trellis codes 
and designing a recursive maximum likelihood decoding algorithm of lin- 
ear block codes using their trellis structure,” Ph.D dissertation, Osaka 
University, March 1996. 

[112] H. Yamamoto, H. Nagano, T. Fujiwara, T. Kasami, and S. Lin, “Re- 
cursive MLD algorithm using the detail trellis structure for linear block 
codes and its average complexity analysis,” in Proc. 1996 Internationed 
Symposium on Inform. Theory and Its Applications , Victoria, Canada, 
pp. 704-708, September 1996. 



284 TRELLISES AND TRELLIS-BASED DECODING A LGORITHMS FOR LINEAR BLOCK CODES 


[113] 0. Ytrehus, “On the trellis complexity of certain binary linear block 
codes,” IEEE Trans. Inform . Theory , vol.4G, pp.559-560, 1995. 

[114] V.A. Zinoviev, “Generalized cascade codes,” Problemy Peredachi Infor - 
matsii, vol.12.1, pp.2-9, 1976. 

[115] V.V. Zyablov and V.R. Sidorenko, “Bounds on complexity of trellis de- 
coding of linear block codes,” Problemy Peredachi Informatsii , vol.29, 
pp.3-9, 1993 (in Russian). 



INDEX 


active span, see span 

add- compare- select (ACS), see decoding 

antipodal convolutional code, 187 

bipartite graph, 85 
block code, 6 

concatenated code, 139-144 
coset, 9 

cyclic code, 66-68 
decoding, 13 
decomposable code, 120 
direct sum, 10, 127, 131 
dual code, 8 
encoding, 7 

extended BCH, 111-113, 216-219 
interleaved, 136 
minimum distance, 11 
non-binary code, 68-69 
product code, 137-138 
punctured code, 39 
Reed- Muller, 

Boolean representation, 17-22 
concatenation, 144-147 
minimum weight subtrellis, 110- 
111 

squaring construction, 118-127 
terminated convolutional code, 
165-174 

|u|u + t?| construction, 20-22 


Reed-Solomon, 69 
squaring construction, 115-120 
weight distribution, 12 
weight profile, 12 
bound 

Wolf, 60-61 
branch 

branch complexity, 

N-section trellis, 64 
sectionalized trellis, 74-78 
branch complexity profile, 77 
branch dimension profile, 77 
parallel branches, 72, 74 
butterfly subtrellis, 188 

Cartesian product, see trellis 
code decomposition, 120 
coded modulation, 137 
compare-select-add (CSA), 189-191 
composite branches, see parallel branches 
concatenated code, see block code 
connectivity, see state connectivity 
constraint length, 30, 151 
convolutional code, 150-152 
antipodal, 187 
punctured, 156-159 

puncturing matrix, 156 
termination, 

tail biting, 162-164 
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zero- tail, 159-161 
correlation, 15-17 
coset, 9 

coset representative, 10 
decoding 

bidirectional decoding, 73 
block code, 13 

Chase decoding algorithm-11, 227 
convolutional code, 175 
differential trellis decoding, 186-193 
compare-select-add (CSA), 189- 
191 

divide and conquer, 195 
iterative low-weight search, 221-241 
maximum a-posteriori (MAP), 243- 
247 

maximum likelihood (ML), 14-17 
bit error probability, 252-256 
Max-Log-MAP decoding, 247-252 
recursive MLD, 195-219 

CombCBT procedure, 202-208 
CombCBT-U procedure, 211-215 
CombCBT-V procedure, 208-209 
composite branch metric table, 
196 

composite branch label set, 211 
MakeCBT procedure, 201-202 
RMLD-(G,U) algorithm, 215-216 
RMLD-(G,V) algorithm, 209-210 
RMLD-(I,V) algorithm, 209-210 
SOVA decoding, 247-252 
Viterbi decoding, 176-177 

add-compare-select (ACS), 176- 
177 

IC implementation, 179-186 
differential trellis decoding, see decoding 
direct sum, see block code 
discrepancy, 224 
distance 

Euclidean, 15 
Hamming, 11 
divide-and-conquer, 195 


edge, see branch 
encoding 

block code, 7 
convolutional code, 152 
extended BCH code, see block code 

Gaussian elimination, 29 
generating pattern, 152 
generator matrix 
block code, 6 

convolutional code, 151-152 
trellis oriented generator matrix, 29 
reduced echelon form, 253 

hard-decision decoding, 13 

iterative low- weight search, see decoding 

Kronecker product, 19, 117 

labeling, see state labeling 
linear block code, 6 
log-likelihood function, 14 
low-weight subtrellis, see subtrellis 

maximum a-posteriori probability (MAP) 
decoding, see decoding 
maximum likelihood (MLD) decoding, see 
decoding 

Max-Log-MAP decoding, see decoding 
memory order, 151 
minimal trellis, 

construction, 78-84 
N-section trellis, 62-65 
sectionalized trellis, 74 
minimi m distance, 11 
minimi m-weight trellis, 101-103 
mirror tymmetry, 55-57 
multilevel concatenation, 139-147 

nearest neighbor test threshold, 226-227 
non-bit ary code, see block code 

optima ity test threshold, 226-227 
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optimum sectionalization, see section a] - 
isation 

parallel branches, 72 

parallel decomposition of trellises, 93-100 
parity-check matrix, 8 
permutation, see symbol permutation 
profile, 28 

branch complexity profile, 77 
branch dimension profile, 77 
state space complexity profile, 28 
state space dimension profile, 28 
punctured convolutional code, see convo- 
lutional code 

purging procedure, see subtrellis 

radix number, 76 
rate, 9 

recursive MLD, see decoding 
reduced echelon form matrix, 253 
Reed-Muller codes, see block code 
row number set, 258 

sectionalization, 71 

optimum, 177-178, 217-219 
uniform, 72 

Shannon product, see trellis 
soft-decision decoding, 13 
SOVA decoding, see decoding 
span, 30 

active span, 30 

squaring construction, see block code 
state 

adjacent states, 28 
final state, 24 
initial state, 24 
state complexity, 60-62 
state connectivity, 76 
state labeling, 43 

information set, 44-47, 260-263 
parity-check matrix, 48-55 
state space, 24, 31, 

state space complexity, 28 
state space dimension, 28 


state transition, 24, 32 
subcode, 9 
subtrellis, 72 

butterfly subtrellis, 188 
low-weight subtrellis, 100-113 
purging procedure, 102-104 
symbol permutation, 64, 217 

terminated convolutional code, see con- 
volutional code 

test 

optimality test, 226-227 
test error pattern, 227-228 
threshold 

nearest neighbor test threshold, 
226-227 

optimality test threshold, 226-227 
trellis 

Cartesian product, 136-137 
concatenated code, 144-147 
construction procedure, 43-47, 48- 
55, 78-84, 263-271 
convolutional code, 152-155 
minimal, see minimal trellis 
minimum-weight trellis, 101-103 
construction, 104-113 
mirror symmetry, 55-57 
N-section trellis, 27 
parallel structure, 73, 85-91 
sectionalized trellis, see sectionaliza- 
tion 

Shannon product, 127-136 
squaring construction, 120—127 
time invariant trellis, 25 
time varying trellis, 27, 35-36 
trellis complexity, 59 
trellis diagram, 2, 24 
trellis oriented form, 29 
trellis oriented generator matrix, see 
generator matrix 
reverse trellis oriented form, 55 
uniform structure, 211 
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U-block, 88-91, 211-213 

uniform sectionalisation, see sectionalisa- 
tion 


vertex, see state 

Viterbi decoding, see decoding 


uniform trellis structure, 211 


weight distribution, 12 
weight profile, 12 



